Data Profiling Report

Dataset statistics

Number of variables	15
Number of observations	33819106
Missing cells	2078068
Missing cells (%)	0.4%
Duplicate rows	0
Duplicate rows (%)	0.0%
Total size in memory	11.9 GiB
Average record size in memory	376.7 B

Variable types

Numeric	10
Categorical	3
Text	2

Alerts

`eval_set` is highly imbalanced (75.3%)	Imbalance
`days_since_prior_order` has 2078068 (6.1%) missing values	Missing
`order_dow` has 6533692 (19.3%) zeros	Zeros
`days_since_prior_order` has 465742 (1.4%) zeros	Zeros

Reproduction

Analysis started	2024-02-14 22:49:43.382485
Analysis finished	2024-02-15 01:06:42.936035
Duration	2 hours, 16 minutes and 59.55 seconds
Software version	ydata-profiling vv4.6.4
Download configuration	config.json

order_id
Real number (ℝ)

Distinct	3346083
Distinct (%)	9.9%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	1710566.3

Minimum	1
Maximum	3421083
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	170921
Q1	855413
median	1710660
Q3	2565587
95-th percentile	3250188
Maximum	3421083
Range	3421082
Interquartile range (IQR)	1710174

Descriptive statistics

Standard deviation	987400.76
Coefficient of variation (CV)	0.57723619
Kurtosis	-1.1994394
Mean	1710566.3
Median Absolute Deviation (MAD)	855085
Skewness	-0.00021110288
Sum	5.7849823 × 10¹³
Variance	9.7496026 × 10¹¹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1564244	145	< 0.1%
790903	137	< 0.1%
61355	127	< 0.1%
2970392	121	< 0.1%
2069920	116	< 0.1%
3308010	115	< 0.1%
2753324	114	< 0.1%
2499774	112	< 0.1%
77151	109	< 0.1%
2621625	109	< 0.1%
Other values (3346073)	33817901	> 99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	8	< 0.1%
2	9	< 0.1%
3	8	< 0.1%
4	13	< 0.1%
5	26	< 0.1%
6	3	< 0.1%
7	2	< 0.1%
8	1	< 0.1%
9	15	< 0.1%
10	15	< 0.1%

Value	Count	Frequency (%)
3421083	10	< 0.1%
3421082	7	< 0.1%
3421081	7	< 0.1%
3421080	9	< 0.1%
3421079	1	< 0.1%
3421078	9	< 0.1%
3421077	4	< 0.1%
3421076	8	< 0.1%
3421075	8	< 0.1%
3421074	4	< 0.1%

product_id
Real number (ℝ)

Distinct	49685
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	25575.515

Minimum	1
Maximum	49688
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	3376
Q1	13519
median	25256
Q3	37935
95-th percentile	47565
Maximum	49688
Range	49687
Interquartile range (IQR)	24416

Descriptive statistics

Standard deviation	14097.697
Coefficient of variation (CV)	0.5512185
Kurtosis	-1.14135
Mean	25575.515
Median Absolute Deviation (MAD)	12080
Skewness	-0.021181543
Sum	8.6494104 × 10¹¹
Variance	1.9874505 × 10⁸
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24852	491291	1.5%
13176	394930	1.2%
21137	275577	0.8%
21903	251705	0.7%
47209	220877	0.7%
47766	184224	0.5%
47626	160792	0.5%
16797	149445	0.4%
26209	146660	0.4%
27845	142813	0.4%
Other values (49675)	31400792	92.8%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	1928	< 0.1%
2	94	< 0.1%
3	283	< 0.1%
4	351	< 0.1%
5	16	< 0.1%
6	8	< 0.1%
7	31	< 0.1%
8	178	< 0.1%
9	161	< 0.1%
10	2691	< 0.1%

Value	Count	Frequency (%)
49688	93	< 0.1%
49687	14	< 0.1%
49686	127	< 0.1%
49685	49	< 0.1%
49684	9	< 0.1%
49683	99728	0.3%
49682	113	< 0.1%
49681	78	< 0.1%
49680	1064	< 0.1%
49679	136	< 0.1%

add_to_cart_order
Real number (ℝ)

Distinct	145
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	8.3677376

Minimum	1
Maximum	145
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	3
median	6
Q3	11
95-th percentile	22
Maximum	145
Range	144
Interquartile range (IQR)	8

Descriptive statistics

Standard deviation	7.1395401
Coefficient of variation (CV)	0.85322228
Kurtosis	5.5752723
Mean	8.3677376
Median Absolute Deviation (MAD)	4
Skewness	1.8123897
Sum	2.829894 × 10⁸
Variance	50.973033
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	3346083	9.9%
2	3182490	9.4%
3	2988129	8.8%
4	2773069	8.2%
5	2542770	7.5%
6	2305545	6.8%
7	2069162	6.1%
8	1840615	5.4%
9	1629258	4.8%
10	1437694	4.3%
Other values (135)	9704291	28.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	3346083	9.9%
2	3182490	9.4%
3	2988129	8.8%
4	2773069	8.2%
5	2542770	7.5%
6	2305545	6.8%
7	2069162	6.1%
8	1840615	5.4%
9	1629258	4.8%
10	1437694	4.3%

Value	Count	Frequency (%)
145	1	< 0.1%
144	1	< 0.1%
143	1	< 0.1%
142	1	< 0.1%
141	1	< 0.1%
140	1	< 0.1%
139	1	< 0.1%
138	1	< 0.1%
137	2	< 0.1%
136	2	< 0.1%

reordered
Categorical

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.1 GiB

1	19955360
0	13863746

Length

Max length	1
Median length	1
Mean length	1
Min length	1

Characters and Unicode

Total characters	33819106
Distinct characters	2
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	1
2nd row	0
3rd row	0
4th row	1
5th row	1

Common Values

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

Most occurring characters

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

Most occurring categories

Value	Count	Frequency (%)
Decimal Number	33819106	100.0%

Most frequent character per category

Decimal Number

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

Most occurring scripts

Value	Count	Frequency (%)
Common	33819106	100.0%

Most frequent character per script

Common

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	33819106	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
1	19955360	59.0%
0	13863746	41.0%

product_name
Text

Distinct	49685
Distinct (%)	0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.8 GiB

Length

Max length	159
Median length	124
Mean length	25.039137
Min length	3

Characters and Unicode

Total characters	846801236
Distinct characters	112
Distinct categories	14 ?
Distinct scripts	3 ?
Distinct blocks	7 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	102 ?
Unique (%)	< 0.1%

Sample

1st row	Organic Egg Whites
2nd row	Organic Egg Whites
3rd row	Organic Egg Whites
4th row	Organic Egg Whites
5th row	Organic Egg Whites

Value	Count	Frequency (%)
organic	10647762	8.3%
	2102315	1.6%
milk	1815686	1.4%
cheese	1526255	1.2%
yogurt	1408187	1.1%
whole	1278905	1.0%
free	1203249	0.9%
original	1039155	0.8%
water	1034453	0.8%
baby	1033852	0.8%
Other values (12050)	105843821	82.1%

Most occurring characters

Value	Count	Frequency (%)
	95298771	11.3%
e	79500100	9.4%
a	72043893	8.5%
r	59745631	7.1%
i	49944474	5.9%
n	46247525	5.5%
o	37243085	4.4%
l	35052759	4.1%
t	34937731	4.1%
s	28299573	3.3%
Other values (102)	308487694	36.4%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	615403153	72.7%
Uppercase Letter	125012253	14.8%
Space Separator	95305265	11.3%
Other Punctuation	5593466	0.7%
Decimal Number	4009771	0.5%
Dash Punctuation	994372	0.1%
Close Punctuation	161110	< 0.1%
Open Punctuation	161110	< 0.1%
Math Symbol	89218	< 0.1%
Other Symbol	70603	< 0.1%
Other values (4)	915	< 0.1%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
e	79500100	12.9%
a	72043893	11.7%
r	59745631	9.7%
i	49944474	8.1%
n	46247525	7.5%
o	37243085	6.1%
l	35052759	5.7%
t	34937731	5.7%
s	28299573	4.6%
c	27358183	4.4%
Other values (29)	145030199	23.6%

Uppercase Letter

Value	Count	Frequency (%)
C	15335757	12.3%
S	14160214	11.3%
O	14159001	11.3%
B	12856452	10.3%
P	7925411	6.3%
F	6229105	5.0%
M	6012593	4.8%
G	5840883	4.7%
A	5110267	4.1%
R	4898369	3.9%
Other values (16)	32484201	26.0%

Other Punctuation

Value	Count	Frequency (%)
&	1964483	35.1%
,	1475039	26.4%
%	1328625	23.8%
'	317239	5.7%
/	203451	3.6%
!	101512	1.8%
.	99198	1.8%
:	38189	0.7%
\	26695	0.5%
"	26695	0.5%
Other values (5)	12340	0.2%

Decimal Number

Value	Count	Frequency (%)
0	1393534	34.8%
1	902835	22.5%
2	760298	19.0%
3	269733	6.7%
5	164604	4.1%
4	162011	4.0%
9	121074	3.0%
8	90551	2.3%
7	73228	1.8%
6	71903	1.8%

Other Symbol

Value	Count	Frequency (%)
®	43448	61.5%
™	26961	38.2%
�	144	0.2%
°	50	0.1%

Dash Punctuation

Value	Count	Frequency (%)
-	990913	99.7%
‑	3223	0.3%
–	236	< 0.1%

Modifier Symbol

Value	Count	Frequency (%)
´	152	87.4%
˚	12	6.9%
`	10	5.7%

Space Separator

Value	Count	Frequency (%)
	95298771	> 99.9%
	6494	< 0.1%

Close Punctuation

Value	Count	Frequency (%)
)	161060	> 99.9%
}	50	< 0.1%

Open Punctuation

Value	Count	Frequency (%)
(	161060	> 99.9%
{	50	< 0.1%

Math Symbol

Value	Count	Frequency (%)
+	84567	94.8%
=	4651	5.2%

Final Punctuation

Value	Count	Frequency (%)
’	154	94.5%
”	9	5.5%

Currency Symbol

Value	Count	Frequency (%)
$	360	100.0%

Control

Value	Count	Frequency (%)
	218	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	740413517	87.4%
Common	106385830	12.6%
Cyrillic	1889	< 0.1%

Most frequent character per script

Latin

Value	Count	Frequency (%)
e	79500100	10.7%
a	72043893	9.7%
r	59745631	8.1%
i	49944474	6.7%
n	46247525	6.2%
o	37243085	5.0%
l	35052759	4.7%
t	34937731	4.7%
s	28299573	3.8%
c	27358183	3.7%
Other values (54)	270040563	36.5%

Common

Value	Count	Frequency (%)
	95298771	89.6%
&	1964483	1.8%
,	1475039	1.4%
0	1393534	1.3%
%	1328625	1.2%
-	990913	0.9%
1	902835	0.8%
2	760298	0.7%
'	317239	0.3%
3	269733	0.3%
Other values (37)	1684360	1.6%

Cyrillic

Value	Count	Frequency (%)
е	1889	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	846698862	> 99.9%
None	69746	< 0.1%
Letterlike Symbols	26961	< 0.1%
Punctuation	3622	< 0.1%
Cyrillic	1889	< 0.1%
Specials	144	< 0.1%
Modifier Letters	12	< 0.1%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
	95298771	11.3%
e	79500100	9.4%
a	72043893	8.5%
r	59745631	7.1%
i	49944474	5.9%
n	46247525	5.5%
o	37243085	4.4%
l	35052759	4.1%
t	34937731	4.1%
s	28299573	3.3%
Other values (77)	308385320	36.4%

None

Value	Count	Frequency (%)
®	43448	62.3%
é	11850	17.0%
	6494	9.3%
ñ	4043	5.8%
è	2703	3.9%
í	469	0.7%
	218	0.3%
´	152	0.2%
â	115	0.2%
ç	68	0.1%
Other values (7)	186	0.3%

Letterlike Symbols

Value	Count	Frequency (%)
™	26961	100.0%

Punctuation

Value	Count	Frequency (%)
‑	3223	89.0%
–	236	6.5%
’	154	4.3%
”	9	0.2%

Cyrillic

Value	Count	Frequency (%)
е	1889	100.0%

Specials

Value	Count	Frequency (%)
�	144	100.0%

Modifier Letters

Value	Count	Frequency (%)
˚	12	100.0%

aisle_id
Real number (ℝ)

Distinct	134
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	71.217985

Minimum	1
Maximum	134
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	16
Q1	31
median	83
Q3	107
95-th percentile	123
Maximum	134
Range	133
Interquartile range (IQR)	76

Descriptive statistics

Standard deviation	38.198982
Coefficient of variation (CV)	0.53636706
Kurtosis	-1.3243685
Mean	71.217985
Median Absolute Deviation (MAD)	33
Skewness	-0.16791174
Sum	2.4085286 × 10⁹
Variance	1459.1622
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
24	3792661	11.2%
83	3568630	10.6%
123	1843806	5.5%
120	1507583	4.5%
21	1021462	3.0%
84	923659	2.7%
115	878150	2.6%
107	753739	2.2%
91	664493	2.0%
112	608469	1.8%
Other values (124)	18256454	54.0%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	74864	0.2%
2	86364	0.3%
3	473835	1.4%
4	210604	0.6%
5	65415	0.2%
6	38086	0.1%
7	35391	0.1%
8	36372	0.1%
9	228123	0.7%
10	9620	< 0.1%

Value	Count	Frequency (%)
134	11659	< 0.1%
133	19580	0.1%
132	6455	< 0.1%
131	277935	0.8%
130	164516	0.5%
129	203452	0.6%
128	201650	0.6%
127	42905	0.1%
126	20801	0.1%
125	37053	0.1%

department_id
Real number (ℝ)

Distinct	21
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	9.9185436

Minimum	1
Maximum	21
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	4
median	9
Q3	16
95-th percentile	19
Maximum	21
Range	20
Interquartile range (IQR)	12

Descriptive statistics

Standard deviation	6.281655
Coefficient of variation (CV)	0.63332433
Kurtosis	-1.5598625
Mean	9.9185436
Median Absolute Deviation (MAD)	5
Skewness	0.15202009
Sum	3.3543628 × 10⁸
Variance	39.459189
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=21)

Value	Count	Frequency (%)
4	9888378	29.2%
16	5631067	16.7%
19	3006412	8.9%
7	2804175	8.3%
1	2336858	6.9%
13	1956819	5.8%
3	1225181	3.6%
15	1114857	3.3%
20	1095540	3.2%
9	905340	2.7%
Other values (11)	3854479	11.4%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2336858	6.9%
2	38086	0.1%
3	1225181	3.6%
4	9888378	29.2%
5	159294	0.5%
6	281155	0.8%
7	2804175	8.3%
8	102221	0.3%
9	905340	2.7%
10	35932	0.1%

Value	Count	Frequency (%)
21	77396	0.2%
20	1095540	3.2%
19	3006412	8.9%
18	438743	1.3%
17	774652	2.3%
16	5631067	16.7%
15	1114857	3.3%
14	739069	2.2%
13	1956819	5.8%
12	739238	2.2%

user_id
Real number (ℝ)

Distinct	206209
Distinct (%)	0.6%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	102944.43

Minimum	1
Maximum	206209
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	10468
Q1	51435
median	102626
Q3	154412
95-th percentile	195732
Maximum	206209
Range	206208
Interquartile range (IQR)	102977

Descriptive statistics

Standard deviation	59467.334
Coefficient of variation (CV)	0.57766444
Kurtosis	-1.2009175
Mean	102944.43
Median Absolute Deviation (MAD)	51505
Skewness	0.0063277961
Sum	3.4814885 × 10¹²
Variance	3.5363638 × 10⁹
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
201268	3725	< 0.1%
129928	3689	< 0.1%
164055	3089	< 0.1%
176478	2952	< 0.1%
186704	2936	< 0.1%
137629	2931	< 0.1%
182401	2929	< 0.1%
33731	2912	< 0.1%
108187	2760	< 0.1%
4694	2735	< 0.1%
Other values (206199)	33788448	99.9%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	70	< 0.1%
2	226	< 0.1%
3	88	< 0.1%
4	18	< 0.1%
5	46	< 0.1%
6	14	< 0.1%
7	215	< 0.1%
8	67	< 0.1%
9	98	< 0.1%
10	147	< 0.1%

Value	Count	Frequency (%)
206209	137	< 0.1%
206208	677	< 0.1%
206207	223	< 0.1%
206206	285	< 0.1%
206205	51	< 0.1%
206204	54	< 0.1%
206203	132	< 0.1%
206202	198	< 0.1%
206201	404	< 0.1%
206200	298	< 0.1%

eval_set
Categorical

IMBALANCE

Distinct	2
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.2 GiB

prior	32434489
train	1384617

Length

Max length	5
Median length	5
Mean length	5
Min length	5

Characters and Unicode

Total characters	169095530
Distinct characters	7
Distinct categories	1 ?
Distinct scripts	1 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	prior
2nd row	prior
3rd row	prior
4th row	prior
5th row	prior

Common Values

Value	Count	Frequency (%)
prior	32434489	95.9%
train	1384617	4.1%

Length

Histogram of lengths of the category

Common Values (Plot)

Value	Count	Frequency (%)
prior	32434489	95.9%
train	1384617	4.1%

Most occurring characters

Value	Count	Frequency (%)
r	66253595	39.2%
i	33819106	20.0%
p	32434489	19.2%
o	32434489	19.2%
t	1384617	0.8%
a	1384617	0.8%
n	1384617	0.8%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	169095530	100.0%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
r	66253595	39.2%
i	33819106	20.0%
p	32434489	19.2%
o	32434489	19.2%
t	1384617	0.8%
a	1384617	0.8%
n	1384617	0.8%

Most occurring scripts

Value	Count	Frequency (%)
Latin	169095530	100.0%

Most frequent character per script

Latin

Value	Count	Frequency (%)
r	66253595	39.2%
i	33819106	20.0%
p	32434489	19.2%
o	32434489	19.2%
t	1384617	0.8%
a	1384617	0.8%
n	1384617	0.8%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	169095530	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
r	66253595	39.2%
i	33819106	20.0%
p	32434489	19.2%
o	32434489	19.2%
t	1384617	0.8%
a	1384617	0.8%
n	1384617	0.8%

order_number
Real number (ℝ)

Distinct	100
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	17.139977

Minimum	1
Maximum	100
Zeros	0
Zeros (%)	0.0%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	1
5-th percentile	1
Q1	5
median	11
Q3	24
95-th percentile	54
Maximum	100
Range	99
Interquartile range (IQR)	19

Descriptive statistics

Standard deviation	17.498287
Coefficient of variation (CV)	1.0209049
Kurtosis	3.3469678
Mean	17.139977
Median Absolute Deviation (MAD)	8
Skewness	1.7742556
Sum	5.796587 × 10⁸
Variance	306.19006
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=50)

Value	Count	Frequency (%)
1	2078068	6.1%
3	2050731	6.1%
2	2048332	6.1%
4	1970180	5.8%
5	1751959	5.2%
6	1577566	4.7%
7	1424796	4.2%
8	1294793	3.8%
9	1188834	3.5%
10	1088920	3.2%
Other values (90)	17344927	51.3%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
1	2078068	6.1%
2	2048332	6.1%
3	2050731	6.1%
4	1970180	5.8%
5	1751959	5.2%
6	1577566	4.7%
7	1424796	4.2%
8	1294793	3.8%
9	1188834	3.5%
10	1088920	3.2%

Value	Count	Frequency (%)
100	7624	< 0.1%
99	12686	< 0.1%
98	13150	< 0.1%
97	13691	< 0.1%
96	14215	< 0.1%
95	14901	< 0.1%
94	15643	< 0.1%
93	15765	< 0.1%
92	16645	< 0.1%
91	17232	0.1%

order_dow
Real number (ℝ)

ZEROS

Distinct	7
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	2.7372854

Minimum	0
Maximum	6
Zeros	6533692
Zeros (%)	19.3%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	0
5-th percentile	0
Q1	1
median	3
Q3	5
95-th percentile	6
Maximum	6
Range	6
Interquartile range (IQR)	4

Descriptive statistics

Standard deviation	2.0932956
Coefficient of variation (CV)	0.76473414
Kurtosis	-1.3366802
Mean	2.7372854
Median Absolute Deviation (MAD)	2
Skewness	0.17983282
Sum	92572545
Variance	4.3818865
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=7)

Value	Count	Frequency (%)
0	6533692	19.3%
1	5871834	17.4%
6	4707583	13.9%
5	4386443	13.0%
2	4378360	12.9%
3	3998498	11.8%
4	3942696	11.7%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	6533692	19.3%
1	5871834	17.4%
2	4378360	12.9%
3	3998498	11.8%
4	3942696	11.7%
5	4386443	13.0%
6	4707583	13.9%

Value	Count	Frequency (%)
6	4707583	13.9%
5	4386443	13.0%
4	3942696	11.7%
3	3998498	11.8%
2	4378360	12.9%
1	5871834	17.4%
0	6533692	19.3%

order_hour_of_day
Real number (ℝ)

Distinct	24
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Infinite	0
Infinite (%)	0.0%
Mean	13.431226

Minimum	0
Maximum	23
Zeros	228031
Zeros (%)	0.7%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	0
5-th percentile	7
Q1	10
median	13
Q3	16
95-th percentile	21
Maximum	23
Range	23
Interquartile range (IQR)	6

Descriptive statistics

Standard deviation	4.2461492
Coefficient of variation (CV)	0.31614011
Kurtosis	-0.009830582
Mean	13.431226
Median Absolute Deviation (MAD)	3
Skewness	-0.047226772
Sum	4.5423205 × 10⁸
Variance	18.029783
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=24)

Value	Count	Frequency (%)
10	2874905	8.5%
11	2852701	8.4%
14	2810918	8.3%
15	2780731	8.2%
13	2778054	8.2%
12	2732599	8.1%
16	2647695	7.8%
9	2550569	7.5%
17	2186409	6.5%
8	1787359	5.3%
Other values (14)	7817166	23.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	228031	0.7%
1	121412	0.4%
2	72660	0.2%
3	53759	0.2%
4	55714	0.2%
5	91909	0.3%
6	302642	0.9%
7	928239	2.7%
8	1787359	5.3%
9	2550569	7.5%

Value	Count	Frequency (%)
23	419585	1.2%
22	662053	2.0%
21	831183	2.5%
20	1017958	3.0%
19	1317576	3.9%
18	1714445	5.1%
17	2186409	6.5%
16	2647695	7.8%
15	2780731	8.2%
14	2810918	8.3%

days_since_prior_order
Real number (ℝ)

MISSING ZEROS

Distinct	31
Distinct (%)	< 0.1%
Missing	2078068
Missing (%)	6.1%
Infinite	0
Infinite (%)	0.0%
Mean	11.364153

Minimum	0
Maximum	30
Zeros	465742
Zeros (%)	1.4%
Negative	0
Negative (%)	0.0%
Memory size	516.0 MiB

Quantile statistics

Minimum	0
5-th percentile	2
Q1	5
median	8
Q3	15
95-th percentile	30
Maximum	30
Range	30
Interquartile range (IQR)	10

Descriptive statistics

Standard deviation	8.9405
Coefficient of variation (CV)	0.78672826
Kurtosis	-0.21991042
Mean	11.364153
Median Absolute Deviation (MAD)	4
Skewness	1.0038359
Sum	3.6071 × 10⁸
Variance	79.93254
Monotonicity	Not monotonic

Histogram with fixed size bins (bins=31)

Value	Count	Frequency (%)
7	3586305	10.6%
30	3477322	10.3%
6	2592077	7.7%
5	2180537	6.4%
4	2126287	6.3%
8	1995636	5.9%
3	1914431	5.7%
2	1492379	4.4%
9	1262383	3.7%
14	1082295	3.2%
Other values (21)	10031386	29.7%
(Missing)	2078068	6.1%

Minimum 10 values
Maximum 10 values

Value	Count	Frequency (%)
0	465742	1.4%
1	960381	2.8%
2	1492379	4.4%
3	1914431	5.7%
4	2126287	6.3%
5	2180537	6.4%
6	2592077	7.7%
7	3586305	10.6%
8	1995636	5.9%
9	1262383	3.7%

Value	Count	Frequency (%)
30	3477322	10.3%
29	191037	0.6%
28	274572	0.8%
27	219711	0.6%
26	190449	0.6%
25	194638	0.6%
24	207537	0.6%
23	241605	0.7%
22	329575	1.0%
21	473730	1.4%

aisle
Text

Distinct	134
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.5 GiB

Length

Max length	29
Median length	23
Mean length	14.450213
Min length	3

Characters and Unicode

Total characters	488693272
Distinct characters	26
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	eggs
2nd row	eggs
3rd row	eggs
4th row	eggs
5th row	eggs

Value	Count	Frequency (%)
fresh	8164266	11.4%
vegetables	5740245	8.0%
fruits	5654560	7.9%
packaged	3336032	4.6%
frozen	1815757	2.5%
water	1756300	2.4%
yogurt	1507583	2.1%
ice	1053908	1.5%
cheese	1021462	1.4%
milk	923659	1.3%
Other values (194)	40904008	56.9%

Most occurring characters

Value	Count	Frequency (%)
e	69815725	14.3%
s	46320231	9.5%
r	41408867	8.5%
a	38341120	7.8%
	38058674	7.8%
t	28715171	5.9%
f	21059844	4.3%
i	19554782	4.0%
o	18449477	3.8%
g	18244592	3.7%
Other values (16)	148724789	30.4%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	450634598	92.2%
Space Separator	38058674	7.8%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
e	69815725	15.5%
s	46320231	10.3%
r	41408867	9.2%
a	38341120	8.5%
t	28715171	6.4%
f	21059844	4.7%
i	19554782	4.3%
o	18449477	4.1%
g	18244592	4.0%
c	17451700	3.9%
Other values (15)	131273089	29.1%

Space Separator

Value	Count	Frequency (%)
	38058674	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	450634598	92.2%
Common	38058674	7.8%

Most frequent character per script

Latin

Value	Count	Frequency (%)
e	69815725	15.5%
s	46320231	10.3%
r	41408867	9.2%
a	38341120	8.5%
t	28715171	6.4%
f	21059844	4.7%
i	19554782	4.3%
o	18449477	4.1%
g	18244592	4.0%
c	17451700	3.9%
Other values (15)	131273089	29.1%

Common

Value	Count	Frequency (%)
	38058674	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	488693272	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
e	69815725	14.3%
s	46320231	9.5%
r	41408867	8.5%
a	38341120	7.8%
	38058674	7.8%
t	28715171	5.9%
f	21059844	4.3%
i	19554782	4.0%
o	18449477	3.8%
g	18244592	3.7%
Other values (16)	148724789	30.4%

department
Categorical

Distinct	21
Distinct (%)	< 0.1%
Missing	0
Missing (%)	0.0%
Memory size	2.3 GiB

produce	9888378
dairy eggs	5631067
snacks	3006412
beverages	2804175
frozen	2336858
Other values (16)	10152216

Length

Max length	15
Median length	13
Mean length	7.9994354
Min length	4

Characters and Unicode

Total characters	270533754
Distinct characters	23
Distinct categories	2 ?
Distinct scripts	2 ?
Distinct blocks	1 ?

The Unicode Standard assigns character properties to each code point, which can be used to analyse textual variables.

Unique

Unique	0 ?
Unique (%)	0.0%

Sample

1st row	dairy eggs
2nd row	dairy eggs
3rd row	dairy eggs
4th row	dairy eggs
5th row	dairy eggs

Common Values

Value	Count	Frequency (%)
produce	9888378	29.2%
dairy eggs	5631067	16.7%
snacks	3006412	8.9%
beverages	2804175	8.3%
frozen	2336858	6.9%
pantry	1956819	5.8%
bakery	1225181	3.6%
canned goods	1114857	3.3%
deli	1095540	3.2%
dry goods pasta	905340	2.7%
Other values (11)	3854479	11.4%

Length

Histogram of lengths of the category

Value	Count	Frequency (%)
produce	9888378	22.7%
dairy	5631067	12.9%
eggs	5631067	12.9%
snacks	3006412	6.9%
beverages	2804175	6.4%
frozen	2336858	5.4%
goods	2020197	4.6%
pantry	1956819	4.5%
bakery	1225181	2.8%
canned	1114857	2.6%
Other values (16)	7968630	18.3%

Most occurring characters

Value	Count	Frequency (%)
e	34494194	12.8%
r	26743514	9.9%
a	22603538	8.4%
d	22169269	8.2%
s	20791011	7.7%
o	20399932	7.5%
g	16163902	6.0%
c	14637634	5.4%
p	13321451	4.9%
n	10919357	4.0%
Other values (13)	68289952	25.2%

Most occurring categories

Value	Count	Frequency (%)
Lowercase Letter	260769219	96.4%
Space Separator	9764535	3.6%

Most frequent character per category

Lowercase Letter

Value	Count	Frequency (%)
e	34494194	13.2%
r	26743514	10.3%
a	22603538	8.7%
d	22169269	8.5%
s	20791011	8.0%
o	20399932	7.8%
g	16163902	6.2%
c	14637634	5.6%
p	13321451	5.1%
n	10919357	4.2%
Other values (12)	58525417	22.4%

Space Separator

Value	Count	Frequency (%)
	9764535	100.0%

Most occurring scripts

Value	Count	Frequency (%)
Latin	260769219	96.4%
Common	9764535	3.6%

Most frequent character per script

Latin

Value	Count	Frequency (%)
e	34494194	13.2%
r	26743514	10.3%
a	22603538	8.7%
d	22169269	8.5%
s	20791011	8.0%
o	20399932	7.8%
g	16163902	6.2%
c	14637634	5.6%
p	13321451	5.1%
n	10919357	4.2%
Other values (12)	58525417	22.4%

Common

Value	Count	Frequency (%)
	9764535	100.0%

Most occurring blocks

Value	Count	Frequency (%)
ASCII	270533754	100.0%

Most frequent character per block

ASCII

Value	Count	Frequency (%)
e	34494194	12.8%
r	26743514	9.9%
a	22603538	8.4%
d	22169269	8.2%
s	20791011	7.7%
o	20399932	7.5%
g	16163902	6.0%
c	14637634	5.4%
p	13321451	4.9%
n	10919357	4.0%
Other values (13)	68289952	25.2%

Auto

Heatmap
Table

	add_to_cart_order	aisle_id	days_since_prior_order	department	department_id	eval_set	order_dow	order_hour_of_day	order_id	order_number	product_id	reordered	user_id
add_to_cart_order	1.000	0.006	0.076	0.030	0.015	0.010	-0.015	-0.015	-0.000	0.001	0.009	0.097	0.000
aisle_id	0.006	1.000	0.006	0.438	0.021	0.006	-0.002	-0.002	-0.000	0.001	0.005	0.088	0.000
days_since_prior_order	0.076	0.006	1.000	0.018	-0.001	0.140	-0.043	-0.002	0.000	-0.383	0.001	0.141	0.000
department	0.030	0.438	0.018	1.000	-0.099	0.019	-0.011	0.002	-0.000	0.008	0.047	0.198	-0.001
department_id	0.015	0.021	-0.001	-0.099	1.000	0.007	0.006	-0.012	-0.000	0.005	-0.022	0.158	0.000
eval_set	0.010	0.006	0.140	0.019	0.007	1.000	-0.005	0.008	-0.001	0.022	-0.000	0.004	0.001
order_dow	-0.015	-0.002	-0.043	-0.011	0.006	-0.005	1.000	0.012	0.001	0.014	-0.003	0.017	-0.002
order_hour_of_day	-0.015	-0.002	-0.002	0.002	-0.012	0.008	0.012	1.000	0.001	-0.047	0.001	0.037	0.000
order_id	-0.000	-0.000	0.000	-0.000	-0.000	-0.001	0.001	0.001	1.000	-0.000	-0.000	0.001	-0.001
order_number	0.001	0.001	-0.383	0.008	0.005	0.022	0.014	-0.047	-0.000	1.000	-0.002	0.337	-0.001
product_id	0.009	0.005	0.001	0.047	-0.022	-0.000	-0.003	0.001	-0.000	-0.002	1.000	0.040	0.000
reordered	0.097	0.088	0.141	0.198	0.158	0.004	0.017	0.037	0.001	0.337	0.040	1.000	-0.001
user_id	0.000	0.000	0.000	-0.001	0.000	0.001	-0.002	0.000	-0.001	-0.001	0.000	-0.001	1.000

Count
Matrix

A simple visualization of nullity by column.

Nullity matrix is a data-dense display which lets you quickly visually pick out patterns in data completion.

First rows
Last rows

	order_id	product_id	add_to_cart_order	reordered	product_name	aisle_id	department_id	user_id	eval_set	order_number	order_dow	order_hour_of_day	days_since_prior_order	aisle	department
0	2	33120	1	1	Organic Egg Whites	86	16	202279	prior	3	5	9	8.0	eggs	dairy eggs
1	26	33120	5	0	Organic Egg Whites	86	16	153404	prior	2	0	16	7.0	eggs	dairy eggs
2	120	33120	13	0	Organic Egg Whites	86	16	23750	prior	11	6	8	10.0	eggs	dairy eggs
3	327	33120	5	1	Organic Egg Whites	86	16	58707	prior	21	6	9	8.0	eggs	dairy eggs
4	390	33120	28	1	Organic Egg Whites	86	16	166654	prior	48	0	12	9.0	eggs	dairy eggs
5	537	33120	2	1	Organic Egg Whites	86	16	180135	prior	15	2	8	3.0	eggs	dairy eggs
6	582	33120	7	1	Organic Egg Whites	86	16	193223	prior	6	2	19	10.0	eggs	dairy eggs
7	608	33120	5	1	Organic Egg Whites	86	16	91030	prior	11	3	21	12.0	eggs	dairy eggs
8	623	33120	1	1	Organic Egg Whites	86	16	37804	prior	63	3	12	3.0	eggs	dairy eggs
9	689	33120	4	1	Organic Egg Whites	86	16	108932	prior	16	1	13	3.0	eggs	dairy eggs

	order_id	product_id	add_to_cart_order	reordered	product_name	aisle_id	department_id	user_id	eval_set	order_number	order_dow	order_hour_of_day	days_since_prior_order	aisle	department
33819096	2637713	2216	1	0	California Champagne	134	5	161786	prior	14	6	3	20.0	specialty wines champagnes	alcohol
33819097	3091866	2216	1	1	California Champagne	134	5	161786	prior	22	5	13	2.0	specialty wines champagnes	alcohol
33819098	3134093	2216	1	1	California Champagne	134	5	161786	prior	21	3	15	3.0	specialty wines champagnes	alcohol
33819099	886132	12825	1	1	Sangria	134	5	137204	prior	13	6	8	13.0	specialty wines champagnes	alcohol
33819100	1894201	25992	1	0	Cristal Champagne	134	5	168275	prior	24	0	14	18.0	specialty wines champagnes	alcohol
33819101	3243156	20731	1	0	Straight Sherry	134	5	166400	prior	3	1	13	12.0	specialty wines champagnes	alcohol
33819102	860862	30582	1	0	Natural Champagne	134	5	104017	prior	13	5	14	18.0	specialty wines champagnes	alcohol
33819103	1333472	27906	1	0	Imperial Champagne	134	5	62079	prior	10	3	10	10.0	specialty wines champagnes	alcohol
33819104	2122701	26086	1	1	La Grand Dame Brut Champagne	134	5	77799	prior	2	3	14	3.0	specialty wines champagnes	alcohol
33819105	3168475	26086	1	1	La Grand Dame Brut Champagne	134	5	5223	prior	7	3	13	2.0	specialty wines champagnes	alcohol

Overview

Variables

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Decimal Number

Most occurring scripts

Most frequent character per script

Common

Most occurring blocks

Most frequent character per block

ASCII

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Uppercase Letter

Other Punctuation

Decimal Number

Other Symbol

Dash Punctuation

Modifier Symbol

Space Separator

Close Punctuation

Open Punctuation

Math Symbol

Final Punctuation

Currency Symbol

Control

Most occurring scripts

Most frequent character per script

Latin

Common

Cyrillic

Most occurring blocks

Most frequent character per block

ASCII

None

Letterlike Symbols

Punctuation

Cyrillic

Specials

Modifier Letters

Common Values

Length

Common Values (Plot)

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Most occurring scripts

Most frequent character per script

Latin

Most occurring blocks

Most frequent character per block

ASCII

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Space Separator

Most occurring scripts

Most frequent character per script

Latin

Common

Most occurring blocks

Most frequent character per block

ASCII

Common Values

Length

Most occurring characters

Most occurring categories

Most frequent character per category

Lowercase Letter

Space Separator

Most occurring scripts

Most frequent character per script